Convergence of Gibbs Sampling: Coordinate Hit-and-Run Mixes Fast

نویسندگان

چکیده

Gibbs sampling, also known as Coordinate Hit-and-Run (CHAR), is a Markov chain Monte Carlo algorithm for sampling from high-dimensional distributions. In each step, the selects random coordinate and re-samples that distribution induced by fixing all other coordinates. While this has become widely used over past half-century, guarantees of efficient convergence have been elusive. We show convex body K in $${\mathbb {R}}^n$$ mixes $$O^{*}(n^9 R^2/r^2)$$ steps, where contains ball radius r R average distance point its centroid. give an upper bound on conductance Hit-and-Run, showing it strictly worse than or Ball Walk worst case.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Hit-and-run mixes fast

It is shown that the “hit-and-run” algorithm for sampling from a convex body K (introduced by R.L. Smith) mixes in time O(nR/r), where R and r are the radii of the inscribed and circumscribed balls of K. Thus after appropriate preprocessing, hit-andrun produces an approximately uniformly distributed sample point in time O(n), which matches the best known bound for other sampling algorithms. We ...

متن کامل

Direction Choice for Accelerated Convergence in Hit-and-Run Sampling

Hit-and-Run algorithms are Monte Carlo procedures for generating points that are asymptotically distributed according to general absolutely continuous target distributions G over open bounded regions S. Applications include nonredundant constraint identification, global optimization, and Monte Carlo integration. These algorithms are reversible random walks which commonly apply uniformly distrib...

متن کامل

CHRR: coordinate hit-and-run with rounding for uniform sampling of constraint-based models

Summary In constraint-based metabolic modelling, physical and biochemical constraints define a polyhedral convex set of feasible flux vectors. Uniform sampling of this set provides an unbiased characterization of the metabolic capabilities of a biochemical network. However, reliable uniform sampling of genome-scale biochemical networks is challenging due to their high dimensionality and inheren...

متن کامل

Hit - and - Run is Fast and Fun ∗

The hit-and-run algorithm is one of the fastest known methods to generate a random point in a high dimensional convex set. In this paper we study a natural extension of the hit-and-run algorithm to sampling from a logconcave distribution in n dimensions. After appropriate preprocessing, hit-and-run produces a point from approximately the right distribution in amortized time O∗(n3).

متن کامل

Coordinate Selection Rules for Gibbs Sampling

This paper studies several di erent plans for selecting coordinates for updating via Gibbs sampling. It exploits the inherent features of the Gibbs sampling formulation, most notably its neighborhood structure, to characterize and compare the plans with regard to convergence to equilibrium and variance of the sample mean. Some of the plans rely on completely or almost completely random coordina...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Discrete and Computational Geometry

سال: 2023

ISSN: ['1432-0444', '0179-5376']

DOI: https://doi.org/10.1007/s00454-023-00497-x